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The growing interest in the application of computer techniques 
for institutional and patient care iMnagemen^ has spawned a ^ 
vaHety of different system approach^. The) cost implications of 
these approaches range from hundredToftnousanlSls of dollars to 
several million dollars for the/lrttividqal hospital. It is widely ac- 
cepted that other than facilities improvement (new construction, 
additions, major remodding, etc.), automated data processing 
representsjthe largest single. capital expenditure facing hospitals 
in th^ future. ^ 

To use this expensive technology effectively, it is imperative 
that the hbspital community be able to not only project the co^t 
of a proposed system, but also be kh\e to assess potential sa*n^ 
so tteit the net cost (or saving) resulting from the application of 
such systems can be estimated. This study provides an.overview of 
the methods available for estimating and measuring tl)e cost im- 
pact, of automated hospital information systems. It will be ob-^ 
vious to the reader that no standard validated methods are avail- 
able for predicting the cost impact of 'this technology. The find- 
ings in the report, however, provide the foundation for future re- 
search which should^ultimately lead to the demonstration and 
validation of methods which individual hospitals can use with 
confidence. 

Gerald Rosenthal. Ph.D. 
Director 
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Background 

Computerization offers the hospital a means of managing an in- 
creasing volume of clinical and administrative information. 
. Since computerized hospital information systems were first used 
in the 1960*s, Numerous products offering varying scope, func- 
tions, and system configurations have Been marketed; s6me hos- 
pitals have even developed their own systems. Consequently deci- 
sionmakers considering automated information handling are 
faced with numerous options, each offering different benefits. 

Computerized information handling qan be very ^costly. A 
comprehensive hospital-wide system — one that integrates patient 
records and reports for all hospital departments — fora moderate 
size hospital may have a purchase price of several million dollars. 
A smaller system processing information for one hospital depart- 
ment, though less expensive, will have more limited impacts on 
hospital operations. Thus, decisionmakers need to consider the 
costs of the various forms of computerized information handling 
and weigh these against the benefits of each option . \ " 

The cost impacts of. Automated Hospital Information Systems 
(AHIS) are the changes resulting from automation that can be 
expressed in term^of dpUars. These Impacts have beeji examinecl' 
in severaf studies. Some have been sponsored by the federal gov- 
ernment and others by vendors of commercial systems and indi- 
vidual hospitals. Since no compendium of the methodologies 
used in these studies was available, the National Center for 
Health Services Research sponsored a study to fdentify and re- 
\ view these methodologies and to prejSare a report summarizing 
and critiquing them. This report summarizes the findings of the 
study.* 



• Copies of the complete report of>he study are available from the National Technical In 
formation Service. The document number is PB 80- 1 78 - 593 , 
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Objectives and Scope of the Study 

The study, had two basic objectives: to evaluate current methods 
for estimating cost impacts of AHIS and to recommend areas for 
future research Existing methodologies for studying cost impacts 
were assembled, reviewed, apd sumrnarij^ed in a. format useful to 
hospital administrators, health planners, and otlier 'decision mak-^ 
eYs. These methodologies were analyzed and the usefulness of 
methodologies from other applications was also considered. 

, The cost evaluation studies considered involved information 
systems that managed data used in patient care - those systems 
dedicated to ad«jjiinistrative functions were excluded, as were sys- 
tems designed primarily for patient diagnosis and treatment 
'(e.g.. ^computed tomography scanners, automated radiotherapy 
planning systems, etc.). 

Approach ' * 

AHIS cost evaluation studies' were^identified by a literature 
search, which included use of computerized abstracting services; 
a survey of vendors of systems per^'orn^ing clinical information 
handling functions, a review of available informatimi concerning 
applications for Certificates of- N(ted, and contacK^with re- 
searchers in the field. Studies dealing explicitly with cost and^cost 
impacts were reviewed, and those that included a description of 
an evaluation of cost impacts were selected for detailed analysis. 
These studies include most of the published work in tfie field. 
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studies cotYcerning AMIS costs ancf cost impacts 



Ten studies.repre^ent the current state of the art of assessing cost 
imparts of AHIS implementation and nf6'st ^f the. published 
work-in the field (1^ 10>. The studies arci listed in Table 1, which 
also presents an overview of the purpose and approach of eadh 
study. , ; • 

/Basic approaches ' ' • ^ 

Two basic techniques have been .used in analyzing the cost in^ 
pacts of automated hospital information systems. In one method, 
the costs before system implementation and after system imple- 
mentation are determined and compared in order to isolate the 
cost impact of the system. In the other type of methodology.. cost 
impacts are^edicted before the syst^ is implemented based on 

^basdkie data concerning hospital operations, knowledge of po- 
tential system impacts, and the experience of other users. This 
type of study is actually ndt a true evaluation in that it is done 
prospectively in anticipation of the ixnp^cts expected in the 
future. The predictive methods are useful for decisionmakers 
coinlidering acquiring an automated iiospital information -sys- 
teen, but the retrospective type of study that examines actual hos- 
pital experience is necessary to provide data on actual impacts 
for use in developing or validating predictive models. 

Before and after studies rely on measurements of the procesSof 
infi^rmat ion -handling and on comparison of costs of certain as- 
pects of hospital operations. Since the baseline data required to 
evaluate'tmpacts are .usually not available from hospital records, 
two periods of data collection are required — one before imp^- 
mentatfon (to establish the baseline) and one a(ter implementa- 
tion. Depending upon the scope of the evaluation, this data col- 
lection effort can be substantial. 

Actual measurement of cost impacts has usually taken plac^ in 
studies in which the number of impacts 'is small, the major im- 

e pacts are easily measured and tied to AHIS functions, and the 



' Table If Overview of AMIS cost studies 



« ' Source 

Afenson.-fl L and . 
J W London, '*Radh 
ology Operatrons Man- 
agement Computer ] 
System, Hospital of 
the University of 
Pennsylvania," in Pro- 
coedmgs of the Amen- 
can College of Badi- 
ology Sixth Opnfer- 
^Bce on CompJter Ap- 
plicattor^m Radi- 
ology March 1979 
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TypeolAHl^ 

^ Radiology Operations 
Management Com- 
puter System perforn)- 

a tng registration and 
scheduling, jite room 
n^anagennrent, patient • 
tracking, reporting, ac- 
counting and statis- 
tics 



institution 
s^ttiiijg 

Unlve/sity teaching 
hospital— radiology 
d6paftment perform- 
ing 130,000 diagnostic 
examinations per y^ar 



Purposeof 
evaluation 

Compare annual costs 
of autcj^atfon anfj an- 
nual cost savings 
achieved (focused on 
directly measureable 
costs and cost"sav 
ings) 
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Study design 

1 Calculate annual costs 
for system hardware, 
personnel, supplies, 
maintenance, and instal 
lation 
' 2 Calculate saV^gs 
actjieved through 

• personnel reductions 
(workload reduced or 
functions eliminated 
such as card filing, 
film library mainte- 
nance, and billing of- 

, fice clerk) 

• recovered t)ill»ng 
losses (2.5% lost 
charges) 

• re^uction»m paper 

< costs (forms eliminat- 
, ed) 
3 Subtract savings from 
I costs to y.ield net costs 



Cost factors/variables 

1 Cost Factors 

•'annual system hard 
ware, software, mam 
tenarvce and installa- 
tion over 8-year sys 
tem lifetime 
• annual salaries (in- 
cluding benefits) 
. • annual supply cost$ 
^ Revenue recovery, as- 
i sumed to have face 
value olfclost charges 



Barrett. J P . P L 
Hersch. and R J Cas- 
\wetl Evaluation of the 
implementation of the 
Te^hnicon Medical In 
forthation System at 
El Camino Hospital 
Part II \conQWic 
Trend Analysts Bat- 
telle. Columbus, Ohio, 
May 14, 1979 ' 



*Techn»con MedicaHn- 
fOrmation STystpcn — 
hospital.wide compuf 
enzed system proc- 
essing a broad range 
' of medical, and adonin- 
istrative data 



El Camino Hospital 
Mountain View. CA 
464-bed general acute 
care, non profit, short* 
term community hos- 
pital compared <with 

• Good Samaritan 
Hospital, Santa 
Clara. 3l5'bed short- 

' term general com- 
munity hospital 

• Sequoia Hospital 
District 4l92'bed 
short-term, general, 
tax district hospital 

• Peninsula Hospital 
and Med Ctr 343- 

. beet; short-term, . 
community hospital 

• Mills Memorial Hos 
pttal 301-bed short 
term, general com- * 
munity hospital • 



4 Validate internal eco- 
nomic analysis at ECH 
^y a trend analysis 

'among ECH and four ' 
other California hospi- 
tals • ' 



Collect monthly hospital 
JpQSt and service data 
over Six years 
(WO- 1975) 
Create a uniform data 
base by aggregation 
into nOrsihg functions, 
therapeutic and diag- 
nQStic ancillaries, sup- 
port services, all depart 
ments. and total hospi- 
tal, using direct ex 
penses 

Expand sample of obser- 
vations by use of pooled 
regression and estimate 
economic impact ot 
TMIS 

Compare estimated im 
* pact with actual e^peri 
ence at other hospitals 



72 variables tested relating 
to administrative measures 
(occupancy, case flow rate, 
•personnel m^x and turnover, 
units of servrce, labor 
hours per case and per pa 
tient day), patient character 
istics (mix by ago, reim 
bursement type, LOS for 10 
selected diagnostic cate- 
gories, surgical proce- 
dures), and costs (per case, 
per day by service, per 
dierp rates, payroll ex- 
penses, prevailing wage 
rates) 
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Table 1, Overview olAHIS cost stucRes, 
(continued) 



Source 

Brian. E,W . era/ 
Cost Benefit Analysts 
of Installation of a 
Spectra System at 
Santa Monica Hospt- 
taf. University of 
Southern California 
Center for Health 
Services Research 
March 21. 1975. Re- 
vised January 1976 




Type otAHiS 

Hospital'wide mini-^ 
cofDputer'bdsed sys- 
t^rr) Spectra 2000 
J 



Institution 
setting ^ 

Santa Monica Hosph 
tal, a 350'bed acute 
care community hos- 
' pital 



Purpose of 
evaluation 

Determine if conoput* 
er^based information 
handling Is cost-effec- 
tive when costs are 
compared with cost 
savmgs in charge cap- 
ture, forms replace- 
ment, and personnel 
< reduction 



Study design 



Cosff^actors/variables 



1 



1 Determine undercharge 
errpr rate m patient bill 
ings by random sam- 
pling patient^charts 
and comparison with 
bills; project total reve , 
nue loss -^"^ 

1 Calculate cost of manual 
forms to be replaced ^ 
(could not be compared 
with cos\,§Jop/€omputer 
systefT) suppjies) 

3» a. Survey departments 
' and select those where 
personnel changes 
might be significant 

b. By time-motion ' 
studies estimate work- 
load reductioi) from 
automation. 

c. Estimate personnel 
cost savings (labor 
force reductions) by 
phasing reductions to 
be achieved from re- 
duced workload over 5 
years (30%, 50%, 66%. 
83%. 100% in the r6> 
spective years) 

4 .Calci^te cost to cost 
saving^ ratio for eacrtv>f 
first 5 system years. 



Assumptions 

1 Increased charge c§p 

ture wrfl result in 
equtvaielit increases in 
hospital revenue 

2 Predicted FTE workload 

reductions across 
units/departmen{s and 
shifts will result in 
labor force reductions 



Cost-denefit Analy^s*'' 
of Data-Care Sy$te/n 
(unpublished). Fairfax 
Hospital System. Fall3 
Church. VA. 



DataCare. Inc hospf ' 
tal-wide computerized 
syst&m. processing a 
broad range of medi> 
cal aru) administrative 
data for inpatients and 
outpatieVits 



Fairfax Hospital 
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Determfna present 
value of system costs^ 
and savings over 8- 
year life cycle of auto- 
mated hospltaimfor- 
mat ion system 



1. Compute system costs 
• i<ft each year of system 
'life 

a capitalize costs/fees 
for hardware and soft* 
ware 

b phase costs for 
start-up, upgrading, 
and internal system 
support 
2 Compute cost s'&vin^s 

for each year of system 

life 

-li^ identify by function 
analysis, non-nursing 
jobs to be eliminated 
and compute payroll 
savings 

compute savings for 
forms and current data 
processing 
c compufd one-tune 
c&sh flow benefit for 
billing office (reduced 

3. CofT\pute net benefit for 
each year. • 

4 CofT^put^nd Sum pres- 
ent va^s (at discount 
ra\gs of 6%, 9%..ap.d' 
12^ t^yield present 
. value 6f lifeticnGTnet 
benefit • * 



Present values^'of annual 
costs, savings'and net 
b'enefits 
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. Source 



Gall, J. E. 

Demonstration and 
Evaluation of a Total 
Hospital Information 
System Natlonafceo- 
'ter for Health Services 
Research NTIS PB 262 
106, 1975 



Type of AMIS 



Technicoh Me<Jical ln« 
forrDation SysterD— 
hospital-wide corD^ut- 
enzed sy^terr) proc- 
, easing a broad ra/fge 
of medical and admin- 
iBtrative data 



Table 1. Overview 



of AHJS cost Studies 



(conilnued) 



Institution 
setting 



El Camino Hospital - 
Mountain View, CA 
464-bed general acute 
care, non-profft, short- 
t^m comrrlunUy hos- 
pital compared with 
SIX similar nearby hos* 
pitats 



Purpose of 
evaluation 



Evaluation of cbst im: 
pact of AMIS 
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study design 



Coat factors/variables 



Predict labor savings by 
use of Methods Time 
Measurement Model 
comparing manuaf vs 
AHIS perlormance pf 
clerical tasks 
Compare trends in nurs- 
ing labor and ancillary 
labor hoyrs actually ex; 
pended after 2 years of 
AHIS with labor hours 
expected to be expend- 
ed under the manual 
method 
. Compare trends in nurs- 
ing and ancillary labor 
at ECH and six-similar 
nearby-hospitals during 
two 18-month frbspitals 
before and after AHIS 
implementation and pre- 
dict difference at ECH. 



1 Labor hours per month 

V 



Nursing labor hours per 
patient-day and ancillary 
labor hours per admis-« 
' s^on 



Nursing labor hours per 
patient-day and per ^ 
mission and Jabor Hours , 
per admission for se- 




r 



r 



Huff. W S andE,J 
Bond Demanstration 
oia Shared Hospital 
Information System, 
The ^isters of the 
Third Order ot St 
Francis, Pooria, IL 



V 



Custom-built system 
for three hospitals 
with a shared com^ 
puter facility 



Three affiliated hospi- 
tals'—evaluation car- 
ried out at only two 
sites ■ 



Test five Independent 
hypotheses relating to 
quality, efficiency and 
cost of patient care by 
comparing selected 
operating characteris- 
tics before ai^d after ' 
system, implemerrta- 
tion 



f 



Control other variables 
by eliminating chan§es 
in unit/department loca- 
tion, procedures, staff- 
ing, etc. during before 
and after experimental 
period 

Cost'hypothesis, system 
implementation can be 
achieved without signifi- 
cantly affecting the cost 
of patient care 

• Measure productivity", 
of nursing staff ^ 
(stanjtard work hours 

. as a percentage of to- 
^ tal clock hours for 
RN, LPN, and trained 
"attendants) and of ad 
^ mitting staff by work 
sampling 

• Measure rebuction in 
cost of routine serv- 
ices by labdV dis- 
placement (standard 
tjmes and volume 
samplings) per pa^ 
tient-day in nursing 
stations and admis- 
sions 

• Measure reduction in 
cost of radiology and/^ 
laboratory services^ 
by labor displace 
ment 



'Percent idle time of 
total clock hours 



' hrs saved per pati^nt- 
day times 
salary/wage 



• hrs saved per proce- 
dure times 
salary/wage 



Smirc* 

Kim. s! H. and H, H, 
SqhrWtz, 'A Cost- 
Btnefit Analysis of a 
Moduter Hospital In- 
formation System.*' In 
M.W. Hopfeledl ' 
American Institute tor 
Decision Sciences 
Proceedings, Boston. 
MA NOV, 14-16.1973 ' 



Typ«of AHIS' 

(not stateti) 



Table 1. Overview of AHtS cost Studies 
(continued) 



institution 
^ setting 

(not'stated) 



Purpose of 
evaiuation 

^ompare actual cost 
*\f modujar AMIS with 
present valu^ of total 
stream of net cash 
flow (resultlr\^g from 
recovery of lost 
charges) 



Study design 

1 06tam revenue in- 
creases for first three 
y^ars frorq actual finan- 
cial data; project next 5 
years by use of 5% an- 
nual increase 

2 Obtain additional costs 
of system for first year, 
project for next 7 years 
b49ed on 5% annual in- 
creases 

3 Compute net casti flow 
changes igains m reve- 
nue minus additional 
costs) for each of 8 
years of system itfetime 

4 Compute present values 
at 6%. 8%, and 10% 
discount rates and sum 
NPV for 8-year system > 
life for each rate 

5. Calculate profitability in- 
dexes by dividing NPV 
by cost of AMIS 



Cost f actors/variabteit 

Assumptions. ^ ^ 
posts and revenue savings 



will increase at 5% 



Misheievich, D J , 
W. G. Gtpe, J R. Hob- 
erts. C Denny. A D 
Stern and M W Day. 
"Cost Benefit Analy^ 
Sjs in a Computer- ' 
Based Hospital infor- 
mation System/' in 
Proceedings of the 
Third Annual- Sym^ 
posium on Computer 
Applicattons in Medi- 
cal Care, 1979 



Radiology department 
ordering, work man 
agement and reporting 
system developed by 
Parkland Hospital- 
Parkland On-Line In- 
formation System 
(POIS) 



University Teaching 
Hospital (Dallas Coun- 
ty District Hospital) 



Determine total de- 
partmental and unit 
costs with and with- 
out the system for a 
standard patient load 



ft 



1(J 



By use of industrial en 
gineering techniques 
and compartmental 
analysis, derive costs of 
an hypotlyeticai average * 
procedure 

• define average proce 
dure' 

• measure direct time 
and labor for all ' 
steps in procedure 

• measure indirect time 
and personnel time 
by work sampling 

• distribute overhead 
over transaction 
Volume for standard 
patient load, adjust- 

%ng post impiementa* 
tion volume to reflect 
avoided duplicate 
procedures (3%) 



4 Annual total cost of pro 
ducing transaction 
^volume for standard pa 
tient load 

Assumptions 

1. Departmental overhead 
and x-ray equipment 
costs same be/ore and 
after 

2 Clerical salaries increase 
due to requirement for- 
data input 

3. Physician costs exclud- 
ed (fee for service) 
hous« staff costs in- 
cluded , . 



Source - 

Schmitz, H. H;, "An 
Evaluation of t^ie Im- 
melWate Financial Im- 
pact, ofthe Hospital 
Information System at 
Deaconess Hospital/* 
p 265-282 in R C ' 
Koza [ed.] Health In- 
formation Systems, 
Colorado Associated 
University Press ^out* 
..der. Colorado. 1&74 



Typ«of AHIS 

(not stated) 



Table 1 . Overview of AH IS cost studies 
^ " (continued) 



Instltutloli ' 
setting 

Deaconess Hospital 
■ St". Upuis. MO r 



Purpose of 
evaluation 

Determine if any sig- 
nificant changes in 
revenue and volume 
indicators fpr the hos- 
pital changed as a re' 
suit of AHIS 



Study design 



Cost factors/variables 



^Calculate direct expense 
per patient'day before 
and after 

• compute non-room 
revenue per patient- 
day 

• elimTnate effect of in- 
flation 

Calculate number of 
tests performed per pa- 
•tlenh<Jay before and af- 
' ter to test for changes 
other fhan recovery of 
"lost" charges ' ' 
Evaluate possible ex« 
planattons for^changes ' 



1 Annual system hard- 
ware, software, mainte- 
nance and installation 
over 8'year system life- 
\ time 

2. Annual salaries (Includ- 
ing^ benefits) 
3 Annual supply costs 



Tech n icon Cost-Ben e- Hospital-wide (Met+iodology may be 

fit Analysis of the , applied to any setting] 

Technicoi>MedicaMn- * 
formation System 
(MIS) For "X" hospital. 
06cemt}er 1975. 
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Project savings Inf 
labor, fofms, equip- 
ment (>ver first 5 oper- 
ational yedrs of l/MlS. 



Calculate labor time sav- 
ings by job title per unit 
of work ^ 
Multiply traffic da*ta 
(daily volume) times unit 
savings to yield FTE 
labor reduction for all 
but nursing 4abor 
Obtain realizable work 
forjce reduction fcy * 
rouq^ling down^or ancil- 
^lary departments and , 
consicferiog fob shiftmg ' 
and other measures for 
oUier departments. 
Calculate labor savings 
per^year based on incre- 
mental changes in staff- 
ing patterns, attrition.^ 
etc including expected 
salary increases. 
Calculate cost avoidance 
for nursing lab'or by re- 
gression based on 
' trends in nursinq labor 
and assume trencl to in- 
creases will be arrested 
(based on experience at 
El Cammo). 
Estimate cost sayings 
for eliminated forms. 



1- Minutes per taslic 
2. Minutes per* day 
3., FTE 

5. fn'E increase avoided 
based on nursing hours 
^er patlent-^ay 

fi^Sperday 



impacts will be realized in a short time (so that the influence of 
other v ariables is minima]) Therefore, most of these studies that 
measured cost savings have b^en conducted for departmental sys- 
tems. The study by Arenson and London (3) is an example of this 
type of approach. ' 

The two, studies at El Camino Hospital (1, 2) and, the evalua- 
tion at the hospitals of the Sisters\f the Third Order of St. Fran- 
cis (6) are examples of attempts to determine impacts of a com- 
prehensfve AHIS by measurement and comparison of a wide 
range of information handling activities and costs before and af 

aer system implementation. 

Methodologies for predicting the potential ,cost impacts of 
automated hospital information systems have been developed to 
examine both comprehensive hospital information systems and 
departmental systems. Most of the predictive methods examine 

.the personnel and supplies (mainly paper forms) impacts and 
compare these with th^ system costs. Examples of this type of 
study are the Technicon methodology (10) and the study by 
Mishelevich et al (8). Most predictive studies consider one-year 
system costs and cost savings. Three of the studies listed in Table 
1 include. a multi year cost analysis. .the Technicon methodology 
(10) includes the first 5 years of^ystem operation and the Fairfax 
Hospital (5) and Kim and Schmitz (7) studies c^ver life-.cycle (8- 
year).c^st impacts ^ " ^ ^ 

Purposes and perspectives 

Varied purposes in implementing an AHIS and in undertaking a 
cost study.and varied expectations regarding cost and other im- 
pacts are reflected in the ten studies jdentjfied. Examination of 
cost impacts was thf focus of studies at Santa Monica Hospital 
(4), and Fairfax Hospital (5), ^amon^-others^ whereas quality of 
care benefits (most of which are difficult to express in dollars), as 
well as qost impacts have been evaluated in the El Camino (2) 
and the Sisters of the Third Order to St. Francis study (6). 

Characteristics of AHIs and settings ^ * 

Systems for radiology departments are examined in the studies by 
Arenson and London (3) and Mishelevich el al (8). The other 
studies included in Table 1 consider hospital-wide automated in- 
formation handling. In the case of the systems at Santa Mqnica 



Hospital (4)an^ Deaconess Hospital, St, Louis (7,. 9), the system 
configurattbn is a modular pr distributed one. Commercial sys- 
tenis are involved in the T^chnicon (10). Fairfax Hospital (5), 
and Santa Monica Hospital (4) evaluations; whereas the systems . 
studied at El Gamino Hospital (1,2) and the hospitals of Sisters 
of the Third Order of St, Francis (6) were early versions of sys- 
tems'that are now commercially available. 

In addition to' system characteristics, the work to dafte reflects 
individual department (3, 8), community hospital (1, 2, 5, 6). 
and university teaching hospital settings (4, 7, 9), Except to the 
degree that the institutional setti|ig influences the information 
Jiandling needs, the type of cost evaluation conduco^and the 
specific methodologies employed are determined more by the ob- 
jectives for implementing automation and the purpose for and 
perspective of the evaluation thari by the charatteristics of the" 
specific system or hospital setting. Therefore, this review of the 
studies has been oriented toward specific methodological issues 
and the generic approaches to analyzing cost impacts found in 
one or more of the evaluation studies cited. 

Practical considerations 

All work onAHIS costijppacts is limited by the resources avail- 
able for the study. Therrtore, most studies are focused on the 
major impacts for which sufficient data can be obtained. 
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Methodological issues in evaluating AMIS costs 



f 

Estimating cost impacts of labor savings ^ 

Hospital information handling is very Jabor-intensive, Clerical 
functions have been estimated to consume 25% of hospital staff 



time and as much as 18% of nursing staff time. Therefore, labor 
savings, achieved through the reduction of cFerjcal workload, are 
a major economic ration4le fgr autQmating|^ information han- 
dling. A hospital realizes direct cost s'avings, however, pnly when^ 
the savings in time devoted to clerical work are reflected in labor , 
force reductions. Therefore there are two, aspects to the^cost im- ( 
pacts of labor savings:- 

(1) Workload reduction and/or redistribution (time\aved) and 

(•2) Labor force redi^lion (personnel eliminated) and conse- . ' 
quent payroll reductf^. ^ 

Most of the studies done to date nave considered labor savings, 
and savings of nursing labor have been-the'largest single cost re- 
ductions identified (or predicted) in most of these. 

Four different techniques have been eniployed'^for estimating 
workload changes: 

^ \\) task* analysis (2. 4, J5, 1(5) — which considers time savings in 
individual tasks by use of industrial engineering techniques, 
such as Methods Time Measurement; 

(2) job content analysis (5)- tHat estimates time savings for. jobs 
substantially changed; ^ ^ ^ 

(3) work sampling (6) — which involves observkiion of actual 
time devoted to tasks; and ^ 

(4) trend analysis (10) — which is based on historical trends in, 
productivity and anticipated changes. 

In task analysis, individual work activities that will be affected 
by automation are identified, e.g., filling out an X-ray requisi- 
tion, telephoning for a laboratory reault. Then the time spent in 
Q the activity in the manual system is measured. The time spent in 



the activity with autiJjnation is mcasurcd/^(in a retrospective . 
study) or predicted (in* a prospective evakiation). This informa- 
tion ih combined with information onffte volume of activity and 
the salary of personnel performing v!?e task in order to Calculate 
jabop saviiYgs Table 2 illustrates fhi^ technique. Task analysis 
provides a complete inventory of jx)tential impacts but translat- 
ing time savings in specific tasks toVeductions in payroll is diffi- 
cult, as will be discussed later. ' ^ 

Job content analysis overcomes some oS the problems ef taskf* 
analysis since it focuses on the emplpycc, rather than the task. 
The Steps in this process include identifying jobs that will be per- 
formed differently^ wjth AHIS, estimating (or measuring) the 
time that- witl be saved, and redefining (combining) jobs to 
realize rhe savings. Table 3 ^hows the results of a job content 
analysis. 

Job conteiu analysis is^ usually performed in collaboration with 
the supervisor of a department, since thorough^nowledge of the 
area is required, and since supervisors must agree to Knplement 
any changes Job content analysis is less time-consuming to J3er- 
form than fask anajysis and result-s are easier to translate into 
realistic staff reductions. It may also be less accurate since judge- 
ments of time savings are used and there may be incentives to in- 
flate or underestimate savings. 

* Work sampling (also referred to as activity sampling) can also 
be used to estinnate labor savings. In this case tlie work performed 
by individuals is docuniented by measuring periodically the ac- 
tivity of personnel in a unit over an extended peyod. The data'* 
are used to describe how individuals or(^ategories of s^aff spend 
their time! Then the activities affected by AHIS can be identified, 
andi the potential labor savings can be estimated (in predictive 
studies) ox measured (in retrospective studies). Since work sam-' 
pkng provides- information on how time is allocated to work ac- 
tivities, it can be used to determine how activities have changed 
(use of freed-up time) and how rr/uch "downtime" exists in man- 
ual and autonnatcd systems, etc. Table 4 provides results of work 
sampling of information handling ^r^tTvitT^s in a surgical inten- 
sive care unit. 

Work sampling is especially useful in analyzing labor impacts 
in nursing units. Nursing staff perform many information han- 
dling tasks in conjunction nith other patient care activities but 
may not devote large blocks of Jtime solely to information han- 
dling. Sometimes information handling and patient care tasks 
are performed simultaneously. Therefore, changes in nursing 
^ activities can be best captured and quantified by direct ob- 
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Funciton 



Job 



• Time 
savings 
(min • 
per unit) 



Table 2. Example of task anal^is for admitting departn^ent 



Voiume 
(units 
per day) 



PTE ^ 
reduQtidn 



Basts for time sav^gs 



• Process Pre-Admlssk>n 



Bed Assignment for 
Daily Admissions 



SubTotali ' 
Process Emergency 
Admission 

f' 

•Process^bheduled ^ 
and Urgent Admission 



Admitting Clerk 

Si 



oVt.Head (60%l 



8.0 



26 



0.6 



4.0 



31 



0.4- 



Assislant Dept. Head 


4.0 


. 21 , 


. 0.2 - 


Admitting Oferk 


1.0 


51 


02 








' 0.8 


Admitting Clerk i 


50. 


17 • 


0.3 


t ^^-^dmlttlng Clerk 


5.0 


52 ' 


0.8 ' 











Preparatlon.of Admission Record and typ- 
ing and filing of admission formjeplaced 
by direct, type-In of reservatlon/pre-admks- 
sion data on VMT .from pHone call or ' 
mallefl-in Pre-admit 'form. Case Card File 
eliminated. Simplifies entry and release of 
pre-ddmit orders and screer\jng. , 
^llmlnatee Maintenance of Bed Availabil- 
ity records and preparation of Bed Cards. 
Replaced by scheduled admit list and bed 
assignment sheet ' 



Eliminates transcription of Adm^fSslon 
data io Admission Form. Faster bed as- 
signments. Ellminate's phone calls from 
Emgrgenc/and checl^s of Case Card File. 
Automatic assignment of n^w control 
numbers. MtS provides on-llne'case # file. 
Eliminates distribution of Admit Records. 
Eliminates distribution of patlen^informa- 
tion to Information Desk and. Switchboard 
and other patient lists* 



Proces$ Transfer 



Sub-Total 
Prpcess Discharge 



Dept. Head (60%) 



Assistary Dept. Head 
Admitting Clerk 



Preparation of Admission Dept. Head or A[sst. 
Lists of Daily Admissions, 
Transfers, Discharges 



DEPARTMENT TOTAL 



Dept. Head 
Asst. Dept. Head 
Admitting Clerk 



3,0 


" 10 


0.1 


3.0 


7 


0.1 






0.2 


.3.0 












1'5.0 


1 


' . 0.1 



0.5 
0.4 
2.3 

3.2 



tElfminates preparation and distribution of 
Transfer Slip. Eliminates making new bed 
► assignment on board 



Eliminates preparation of Discharge No- 
tice and distribution of same 
Preparation eliminated. Computer' auto- 
matically prints^llst. 



Source Technicon M^ical Information Systems Corp . CoiZ-Be/ie/// AnaiysfS ot lh» Techntcon Medical In tormaffon Systam (MiS} tor Unnamed Hospital December 1975 
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Table 3. Example of job contetit analysis for a radiology department 



Job 


tasks 


Ssved houri • 
per dey \ 


Technician 1 , , , 
Technician 2. . 
Technicians. , 
*" Technician 4 . . 


, perform exams, 
perform exams 
scheduling, perform exams* 
perform examftrretneve files 


0 V 

? • ' 

3 


Cierkf 

Clerk2 
-Cierk3.. 
Clerk4. 
Clerk 5 


. .transcription of reports 

. sc^eduiing/phone • 

phone/x-Fay filing . ^ . ' 
phone/schedjulino/lrepo/t distribuWon 
phone/requisition proces^ling/receptioni^l 


7 
4 

•r 


^ T 

Source Arthur 0 Little. InC 



''servation (as in work sampling). * 

Trend analysis involves examining trends in^ cost variables 
(i.e., nursing cost/patient day) prior to AHIS with those after 
AHIS to identffy and quantify changers. The technique is used 
most often in retrospective studies but can also be used Wospec- 
tively if th^yrc is inform'Stion available to project trends. Perform- 
ing a trend analysis to estimate labor savings involves first collect-' 
ing jiistorical data on trends in labor productivity and ext^po- 
latihg these trends into the future. In retrospective studies, pro- 
ductivity after AHIS would be plotted, in prospective studies fu-' 
ture productivity must be estimated. Ot;jcrTh^ trends with and^ 
without the AHIS have been plotted, th^ the\wo productivity 
lines are compared in order to estimate labor^grOTuctivity differ- 
ences at differ^ points in time. Table 5 anci Figure 1 show an 
example of trend analysis oPproductivity pf nursing labor on^n 
inpatient.unit. 

Result-s from trend analysis are difficult to interpret because 
.changes in labor cost or productivity can ,be*lhe result of many- 
causes other than changes in information handling tasks. Major 
influences on staff productivity'may result from changes in the 
patient mix, the occupancy rate, regulatory and payment 
policies, or the addition of new services (especially intensive care 
services)/ldentifying and adjusting for these other variables to 
isola^he impact of an AHIS is a difficult undertaking. Further- ^ 
mote, the large number of institutional variaji>les nriake it' impos- 
sible to generalize the results of trend analysis per/ormed in one 
institution to other hospitals. 

An overview of the steps involved in estimating workload and 
personnel reduction for each methodology is presented in Table 
6. along with the advantages and disadvantages of each ap- 
proachr At the present time, the most efficient approach appears 
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'Table 4. Results of nursing stall wprk sampling In a/sUVglcal Intensive care unit 
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Activity 



11 ^ Patient Measurements, 

/ (Monitor Type) 

32 Non-drug Ordering, r 

33 Druq Recording 
34. Non-drug Recording 
45 Review Patient hecorcjs 

52 ^ Communication with Nurses 

53 ' Cbmm;jnrcatipn with Doctors. 

71 Research 

72 Teaching or Education 

Total ' 



•Day 



Hours pershitt 



Hour^ffXrpaUent 



^ ^> 1.4 



Evening 



'Night 



Day 



Evening 



"1 



0.8 ' 

0.1 

4.9 

3.9' 

4.25 
28.2 . 



0.8 

0.4 
0 

3.0 
' 3.4 
4.1 
1.6 

■ 0.3 
13.6 



'^0.5 

1,1 ' 
. 0.1 
4.4 
33 
3,6 
. 3.1 

[oA 
lfe.5 



0,2 

'O.l 

0.6 
0^4 
,1.1 
0,4 

0.5 
3.2 



0.1 

0.1 

0.3 
0.4 
0,5 

0.2^ 

T5~ 



- Night 



■0.1 

0.1 

0>6_ 
0.4 
0,5 
0,4 

0,1 
2.1 



Total 



0.4 
0,3 

1^ 
1.0 

0.6 
6.8 



Source Arfttur D Little, inc . Peytevfot the Medlab System ip the Surgtcai intensive Care Unit at the Massachusetts Generai Hospntai, Appendix A Report to the National Center for Health 
Services Research^ndOeveiopment. Contract HSM 110-70-406, March 1973 ' ' ~ ' *\ 
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Table 5. Example of prediction of avoided Increases (n nursing costs 



^ ] » ^977 1976 1979 1980 i98l 

Nursing hours per patient day: . ' 

~!;!!ku.q^'1; ' -...7.69 7.90 . 8.10 8.31 8.51 

^ -with MIS ^ 7.60 7.60 . 7.60 7.60 7 60 

-increase aWance with MIS 0.09 0 30 0 51 0 71 ^ 0 91 

•Med/Surg, patient days per month 9.698 ^ 9,485 9^272 9 059 8 846 

Med/Surg, nursing hours Increase avoidance with MIS . 873 2 846 4 729 6 432 8050 

Full Time Equivalents 5.04 i6.4^ ' 27.28 37 11 46 45 

Average salary, including fringe : $1,333 $1^432 $1^533 ^^^2. ^ $1774 

Kf ed/Surg. cost avoidance .$6,718 - $23,513 $41,969 $61,305 $82,404 

' * - — ^ « — . ■ 

Obsftncs . " ' ' c 



1)1 ursing hours per patient day: 

-wIthoutMIS , 880 9.72 IO64' ^ 11 56 1248 

.-wIthMIS.' ^ 8.42 8.42 8.42 8.42 842 

—increase avoidance with MIS ' /. 0.38 1 30 2.22 314 4 06 

Obstetrics patient days per month.' 730 699 . 669 ^ 638 608 

Obstetrics nursing hours Increase avoidance with MIS. : 277 827 1 485 2 003 2 469 

Full Time Equivalents 1.60 4.77 857 11 55 • 1425 

Average salary, including fringe $1,333 $1,43^ $1,538 .$1 652 $1*774 

Obstetrics cost avoidance^ $2,133 $6,834 $13,179 - $19 094 $25 274 
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09C 


Dec! 


Oac.c 


'Dec 


Dec 




1977 


1978 


* 1979 


1930 


1981 


N ursing hours per pailent day: 










■\ 


—without MIS. . 


'9.30 


9.73 


p 10.48 


11.23 


11,98 


—with MIS . ..^ 





8.98 


8.98 


8,98 


8.98 


— increase avoidance with MIS 


. . ..jb.32 


1.07 


1.82 


2^57 


3!32 


Newborn patient days per month , 


%08 


578 


578 


547 


517 


Newborn nursing hours increase avoidance with MIS 


' 1 95 


618 


1,052 . 


1,406 


1,716 


Full Time Equivalents 


1.12' 


3 56. 


6.07 


8.11 


9.90 


Average salary, Including fringe 


$1,333 


$1,432 


$1,538 . 


$1,652 


$1,774 


Newborn cost avoidance i 


$1,493 


$5,110 


$9,336 


$13,401 


$17,570 

/* 


Summtfy ^ ^11 S9iv/C9S 












Full Time Equivalents 


* 








f 




5.04 


16.42 


27.28 


37.11 


46.45 




1 .60 ^ 


4.77 


8.57 , 


11.55 


14.25 


—Newborn 


1.12 


2.68 ' 


6.07 


8.11 


9.9a 


—Total 


7.76 


23.87 


41.92 


5677 


70.60 ' 


Cost Avoidance 














$6,718 


$23,513. 


' $41,969 


$61,305 


$82,404 


—Obstetrics 


2,133 


6,834 


13,179 


19,094 


25,274 




1,493 


5,110 


9,33p 


13,401 ' 


17,570 




$10,344 


$35,457 


$64,484 


$93,800 


$125,248 



Source Technicoo Medical in tormatwn Systems Qorp . Cost Benefit Analysis of the Tectinicon Medical Information System (f^lS) for Unnamed Hospital) December 1975 



to be using job.contcnt analysis for hon-nUrsing labor and work 
sai^pling for nursing labor. 

Several questions must be answered before the potential work- 
load reductions can be translated into realistic estimates of labor 
force reductions: • t 

• What IS the minimum staffing in each area that will be re- 
quired independent of the clerical workload? 

• Can time savings within a unit,be realized across shifts? 

• Can time savings within a unit be summed across labor cate- 
gories? 

• Can time savings be realized acr(yss nursing wards? 

• Can savings of partial PTEs be realized? 



(0 

c 

CO 

a 
a 

(0 

3 
O 

I 7 

Z 



.0^ 



Increase avoided • 
(Productivity savings) 



Prediclecf AHIS trend line 



•1975 1976 1977\ 1978 1979 1980 1981 1982 1983 
^ ^ , ^ Year 

Note Trend lines are not based on actual data and are presented only to illustrate the use of trend 
analysis to estimate cost avoKJance 
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O FIGURE 1. Sample trend analysis of nursing productivity on medical/surgical 
* ^ service for use In study of laborcost avoidance 
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Table 6. Overview of methodologies for predicting cost impacts of labor savings 



Ta$k»natysi$ 



Job<Mnt9nt analysis 



^ork sampling 



Treniianstysis 



Estimate 
Workload 
Reduction 



1 Identify information han- 
dling tasks 

2 Measure time spent to per- 
fornr) task by each labor cate- 

' gory 

3 Estimate time required to 
perform task with AHIS and 
the labor category involved 

4 Calculate time difference for 
each task by labor category 

5 Document volume of tasks 

6 Multiply time difference for 
task by volume. 

7 Convert time savings for 
task into FTE labor cate- 
gories 

8 Sum FTEs for all tasks 



Identify job positiorrs with 
workload to be changed 
substantially 

Estimate amount of time de* 
voted to the affected tasks 

Estimate^ time savings by 
)ob category 



Measure staff time spent in 
performing tasks by activityi 
sampling 

Predict time required for 
information handling tasks 
after implementation of 
AHIS » 
Estimate time savings by 
)ob category 



1 Collect historical data on 
trends in tabor productivity 

2 Plot trends and extrapolate 
into future ^ 



3, Estimate productivity 
change after implementa- 
tion of AHIS 

4. J'lot trend line for post-AHIS 

productivity 
'5 "Calculate productivity differ- 
ence between historical 
trend line and AHIS trend 
linb at specific times in the 
future 



Estimate 

Labor 

Savings 



9. Ideiitify staff reductions 



10 Calculat&payroM saving? for 
^ eliminated ]obs. 



Realign jobs and atteT staff- 
ing, patterns for adjusted 
workload 

Calculate payroll savi^tgs for 
eliminated jobs 



Correlate time savings Wjth 
staffing changes. 
Calculate payroll savings for 
elfrninated jobs. 



Calculate payroll difference 
(cost avoidance) basecl on 
productivity savings. 



Advantage. "Complete inventory of potential 

impacts 

Disadvantage Costly and time consuming^ 



Less costly ^and results easier to 
translate into realized labor sav- 
ings a 
Less accurate 



Provides "snapshot" of how time 
IS spent before and after automa- 
tion 

Costly and time consuming » 



Easy to apply 



Lack of productivity standards for 
various labor categories make ac- 
curate labor saving predicting 
difficult • 
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Som^ of the published work to date. on AHIS cost impacts has 
been based on unrealistic assumptions about realizing the poten- 
tjal labor savings and this has lead to overstated cost impacts. 

To illustrate the importance of these questions, coYisider the 
data presented in Table 7. Here savings in minutes of time per 
day have been converted to PTEs by dividing production work 
minutes per day (adjusted for vacations, holidays and illness) and 
summed for each njursing station, shift and job category. A quite 
conservative estimate'will be obtained if one rounds savings down 
to the nearest whole PTE for each labor category within each 
shift and unit. This would mean that in two wards no savings 
would.be predicted, and only onepr two staff reductions would 
be counted in the remaining areas. A total of 17 saved PTEs 
would be predicted. Alternatively, if one assumes that all partial 
ETE savings can be realized, then^hese projections could be con- 
verted directly into labor force savings of 47.4 PTEs. It is easy to 
see that the treatrii^t of partial PTEs is critical to the resulting 
estimate of realizable labor savings.- 

The real savings to be realized from the example in Table 7 
probably lie somewhere between 17 and 47.4 PTEs. For ex- 
ample, if one were to take a conservative approach to converging 
timesavings to PTE staff reductions, one might: ^ 

• ' Assume savings can only be summed within one department. 

• Assume^transfer of tasks from lower tc higher level staff to 
realize t«Tie savings: RN's taking on functions previously per- 
formec(i)y aides or clerks, technicians replacing clerks in ancil- 
lary departments, 

• For nursings departments assume^mall amounts of time sav- 
ings (less than 0.2 FTEs) can be transferred between shifts. 

• Assume that 50% of the time savings of 0.5 PTE or more can 
be realized by use of part-time staff. (In some cases savings won't 
be possible because of core staffing requirements, e.g., at leasts 
one ward clerk must be on duty or answer phone). 

• Round remaining partial FTEs down to next lowest whole 
FTE. , ^ 

.When these assumptions are applied to the workload savings 
estimates from El Camino Hospital, the resulting estimate of 
realizable labor saving for the nursing units in Table 7 is SfiT PTEs 
(Arthur D. Little, Inc., estimate). 
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Table 7. Example of potential labor savings for nu^^sing services^ 

Estimlated labor savmgs (F TE) 



ng^c 



Day shift 



Evening sh/t 



Night 
shift 



Station 

1 South 
Maternity 

2 East . 

2 West 
Pediatrics 

3 West 

4 West 

5 East . 

5 West 

6 East, 
6 West 



Ward 
Clerk 



RN/L VN/ 
Aide 



46 
1 23 
1.04 
1,00 
80 
95 
1 01, 
1 20 
92 
90 
81 



■^78 
1.67 
1 37. 
1 32 
88 
^^7 
1 31 

.1 66* 
1.20 
1 23 
1.11 



Ward 
Clerk 



23 
40 
42 
44 
33 
40 
44 
53 
43 
38 
.34 



HNIL VN/ 
Aide 

66 

1 oo\ 

93 ' 
85 

.60 
1 GO 

191 



76N 



RN/LVNI 
Aide 



Total 



.51 
1 66 
.82 
81 
.76. 
84 
.88 
94 
76 
73 
69 



' 2.64 ' 
' 5.96 
4 58 
4.42 

3 37 
4.66 

4 55 
S.38 
4 08 

%.05 

" iZl 

^47 40 



Source Gall J E Wp/ l>i'mun.Mrali„naniif-i<iluait,>n«(a I nl*lHniptlaUnformait.,nSyslf}> 
HrjhhSrfv«r^Rrvjr<h S I IS PB 2b.J lOb 1975 

Realizing labor savings 

The automation of information handling and communication 
through an AHIS offers many jpotential labor-^ng benefits to 
the hospitajt: Eliminating entire functions (e.g.. preparation of 
billing chjfrge slips) often means that easily identified jobs can be 
eHminate|(e.g., billing clerks). However, the bulk of the clerical 
labor savihgs are morejikely to otcur'piecemeal across many de- 
partments, shifts, and labor categories. 

Turning these time savings into labor force reductions requires 
a deliberate effort to reorganize services by undertaking Vork 
methods improvement, redistributing job titles, and redefining 
job roles among various labor categories. Without an active 
benefits realization effort, activity displacement may.result in in- 
creased idle time for hospital staff rather than in payroll savings. 

Also, labor benefits following implementation of ^n AHIS are 
only achieved slowly as the staff learns to use the system and tdke 
advantage of its labor-saving features. Actual saving are realized 
in increments and maximum savings are not likely to result for 
sevei:al years. * ' 



Choosing an economic analysis methodology. 



In decisionmaking about acquiring -an AHIS. costs^ and benefits 
(cost savings) should be evaluated as ^ey would be fpr anymajor 
investment. Typically, a hospital first incurs a large initial capi- 
tal cost and only realizes economic benefits^increhientally in later 
n9.r> • ' : ' 27 



years Present value methodology applied, to a life-cycle xost 
• ^ analysis provides a useful analytical framewprk fof valuing the 
^ anticipated stream of economic savings (net benefits) over the 

useful lifetime oPthe system. Jt employs discounting procedures 
to reflect the fact that» benefits received in future years are wprth 
less than the' same amount of money today. Thus, it permits a 
comparison of expected future be^pfits and present expenditures 

• that incorporates the time value of money. 

Selecting the appropriate discount rate is one problem in 
applying the present value technique. Discount rates used range 
from 2 5% to 12% the larger the discount rate, the lower the 
present value'of future moneys. Because there is no consensus 
among economists as to which rate to use, ^veral are often used 
and the results compared. Life cycle analysis requires an assump- 
' lion ab(5ut the useful lifetime of the AHIS. Although computer 
systems such as AHIS-are continually maintained and enhanced, 
at some point ^he requirements on the system aft d the availability 
of more cost effective systems make them obsolete, A system life 
cycle of eight yearj has been used in most AHIS cost evaluations 
and seerns'to strike a reasonable balance between the timephas- 
ing of new computer generations and the investment required to 
impletlnent a new system. 

4 

' Calculating system^cost 

Documentation of system costs apj^ears at first to be- a simple, 
, straight forward task. Indeed most previous studies have devoted 
little attention to this area, using only system purchase price and 
installation cost as measures of system costs. Actually total system 
cost involves a large number of components: 

• manpower required for selection and planning activities; 

• initial hardware cost; ^ 
initial spftware cost; 

• facilities renovation to accommodate the system; 

• cost of money to finance the installation; 

• installation costs (vend&r charges and personnel supplied by 
hospital); 

• hardware and software modificatiort's or additions (by vendor 
or in- house) both during implementation and subsequently over 

^ <he system's lifetime; 

mo 33 . 
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• • 'supervision of system installanon and start-up; 

• training of staff in AHIS'use and time s'pent by users in learn- 
ing the sytem; andr , ' ^ 

• support personrtel to manage the system .and interface with 
users; . 

*• cost of special supplies, support services, overhead, and other 
operational expenses. 

Thus a careful accounting of system costs must include expen- 
„ ditures for services and equipment obtained from a system or 
service vendor and the investment -in^in- house personnel required 
\o install and utilize the system. When system costs are being 
compared with labor savings, the cost of a benefits realization ef- 
fort to bring about the necessary operational changes needs to be 
included as well. ' 



Using regression analysis 

One approach to studying impacts of AHIS implementation 
retrospectively is regression analysis. In its simplest form, the sta- 
tistical technique uses time and trend lines for various cost or 
.productivity indicators (su^d^ as nursing hours per patient day). 
. These indicators are calculated from historical dat? points, 
which are used to extrapolate what the indicator would have 
been without AHIS. The extrapolated data are then compared 
with actv»l-values for the comparable indicators after the AHIS 
is iirW More complicated forms of regressions include com- 
parison of trends across comparable hospitals and multiple re- 
gression analysis, which attempts to include in the equation the 
many- independent variables, in addition to implementation of 
an AHIS, that may influence the dependent variable of interest. 
Simple trend analysis does not account for confounding factors 
such as implementation of utilization review or change in case 
mix of the patient population; multiple regression, which can 
handle these factors, is more difficult to apply. « , 

A number of factors make regression analysis difficult to use: 

• In muViple regressions, measures of important independent 
variables may not be available. ^ 

• The results of regression analysis may be biased by variables 
that are unknown or omitted for practical reasons. Variables 
must be selected carefully and interactions understood or the re- 
sults may be misleading. 

•O, 29 
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• Seasonal effects, which can be important, require several years 
of 'data both bofort* and after AHIS implementation, in order t;o 
control for their influence on the dependent variable(sX 
examined. 

• Although comparisons across hospitals can help control for the 
effects of outside influences^ inter hospital comparisons are ham- 
pered by the difficulties of measuring all the factors and inherent 
differences between hospitals. ^ 

Nevertheless, when applied ^carefully, regression analysis can 
be useful in evaluating the impact of AHIS on hospital costs, and 
in validating the results of industriaUengineering studies. Regres- 
sion analysis is used in some previous studies (1, 2). However, re- 
gression analysis can be costly in terms of its ^Ccial data collec- 
tion requirements, and becayse of the difficulty in understanding 
the underlymg relationships between variables. ' it probably, 
should not be th^ only analytical technique used. ' ^ . 

Including quality of care benefits 

The motivation for implementing an AHI^ is rarely only cost sav- 
ings. Improved information handirng can result in benefits to pa- 
ti^t care that are difficult to translate into economic terms. 
Benefits such as improved response times for communications 
and increased availability of nursing staff time for direct patitnt 
care have been documented at all sit^ where they have been 
studied (2, 6). There are indications that AHIS may shorten ' 
length of stay by shortening turnaround time for ancillary serv- 
ices (1). The cost* savings implftatidns of changes such 'as thes^ 
have not yet been tied conclusively to automated ir!|^ormat^on 
han41ing. 
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Comparison of three predictions of AHIS cost 
impacts 



*rhree .predictive cost studies of comprehensive AHIS are availa- 
ble for community hospitals of similar size (400-600 beds): the 
' study by Gall et al. at El Camino (2), the Technicon study at an 
. unidentified hospital (10). and the study for Fairfax Hospital (5). 
These v^efe compared in order to examine the consistency of the 
resul^ and to determine how differing assumptions affect the 

• predictionsof cost impacts. • ■• 

A comparison of predicted total artnual and per-patjenx day. 
savings is presented in Table 8. In order to make, the study results 
more comparable, the figuVes shown do nor ipclude estimates of 
savings baseid upon unique and, less accepted assumptions. The 
estimated savings"due to'" work, methods improvement at El' ■ 
Camino were expected to result from an intensive program to 
realize nursing labor, savings. Because these savmgs are not^di- 
rectly attributable to the AHIS alone, they, are nofincUided^The 
"nursing cost avoidance" estimates in the Technicon study based 
upt.n trend analy^s and the hypothesized stabilization of nursing 
productivity following implementation of the AHIS are also not 
shown. Note that the Fairfax study did not include nursing sav 
ines because the system tould be cost justified on the basis of sav- 
ings in nonlnWsing labor and the authors believed that realizing^ 
nursing lab6r Savings would be difticult. 

Table 9 pre; ents the estimates cost savings in the ancillary and 
support areas.Iby individual departments for the three hospitals. 

• As indicated, no't all three hospitals examined savings in all 

^« areas X 
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Table 8. Comparison of predicted annual 


and per patient day savings frorn three predictive studies of AHIS cost 1 


m pacts 










Savings 






* 










Annual 






Per patient day 


• 


Typeot savmgs 




El Camin o 
m-'79) 


Technic on 

f77.'aii 


Fairfax 

cao-av 


El Camino 


Technicon 




Nursing personnel . . . 
Non^nursing personnel . 




.... . . $ 807,000 » 

209.616^ 


S 604,999' 
350,765 


$ NA 

533,107 


$ 6.56 
1.71 


$•4.84 
2.81 


$ NA 

" a^o 


Total labor 




$1,016,616 


S 955 7fi4 


4000, lUr 




, 7.65 




Equipnnent 

Forms 

Materials and other. . 




. ..,..$ 7,044 
. ... -57,732 
13,380 


$ 13,788 
75,216 


$ 50.848 
20.800 
92,192 


06 

' . ^47 , 
' .11 


11 
.61 


.27 
.11 
.48 


Total non>tat)or ^ 

TaTAL : . 




-$ 78,156 

' '$1,094,772 


$" 89,004 
$1,044,768 


. $163,840 . 
$696,947 ' 


.64 ' 
$ 8 90 


72' 
• $ 836 


.86 

> $ 3.66 ' . 


^ Does not inCHidenursmg savings — 
',Wofk Meihod Improvemeni not mcluded 
^ ''Cost Avoidance" noimclucjed 
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tabit 9. Estimilad anciijary and support cost savings from three predictive studies of AMIS cpsts 

— ; j ' : ■ ^ ^ — 

' * 1 , . Total annual savings 



Area * ' ElCamino % Techmcon % Fairfax % 



Inpaiient registration/admission .0 f /$ 62,142 ' 35 $ 46,476 i&S $ 39,500 - 6 

Laboratory .v. . s . . . . - - 46,476 15.5> 139,524 20 

Medical records . .r:.,.. — - 30,984 10 96,530* 14 

Outpatient/ER/clinics — — — — 90,700 13 

Pharmacy < 37,809 21 117,223 39 199,145 29 

X-Ray , ^. 12,734 7 17,342 6 79,248 12 

Utilization review - . . . .-tTTI". — — — — . 37,900 6 

Business office/accounting r: 53,832 31 43,423 14 — — 

Central service...^ 10.930 6 — — — — ^ 



TOTAL : • $177,445 100 $301,924 100 $682.54? 100 * 
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After eliminating the savings based on questionable assump. 
tions. the estimated tost impacts for the hospitals considered in 
the studies, are approximately $1 million per year, equivalent to 
about $9 pef patient day. These impacts would increase with 
lime, principally because of inflation (estimated at 7-8% per 
year) Since personnel costs escalate -faster th^n system co^s 
(whichjend to be more fixed by contract), the comparison of sav- 
ings versus AHIS costs would also tend to improve over time. 
These projected savings have to be compared with system costs in 
order to estimate the net cost impacts of AHIS implementation. 

The majority of the predicted cost impacts (over 90%) come, 
from potential savings in personnel. Such sa<^ihgs amount to ap- 
piiOJ^mately $8 per patient day,. Of these savings, the majority 
(60-80%) is attributed to reduction of nursing personnel require- 
ments As discussed previously in this report, achievement of this 
reduction is dependent upon a significant effort directed to 
'achieve the savings through reorganization of nursing staff tasks 
and staff schedules, so that the personnel reductions do take 
place. 

The non personnel savin(gs are considerably more modest, un^ 
der $1 per patient day. Reduction of forms in the hospitals c^n 
contribute about $.50 of this reduction. 

The ancillary department with the consistently greatest savings 
was pharmacy, \vhich accounted for between 21-39% of esti- 
mated ancillary savings. The next most ii^iportant department 
was inpatient registration/admitting, which accounted for be- 
jween^6% ahd 35% of ancillary savings., These wqre followed 
" next by laboratory with 15% and 20% of savings* and radiology. 
with6% and 12% of thesavings. , . , 

The savings shown in Table§ 8 and 9 should be considered in- 
dicative of order of magnitude estimates only, since they apply to 
different, time petTrKtsr^nd were based upon somewhat different 
assumptions with regard to personnel and non-personnel infla- 
tion rates, personnel fringe benefit rate^. etc. 
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Analyzing revenue implications 



Published analyses of AHIS i^ost impa^l^have varied greatly in 
their treatment of the revenue iniplications of aii AHIS. In the 
Fairfax Hospital study (5), reduction in receivables was treated as 
a one-time cost saving. One study did not include the effects of 
iricreased revenue capture because of the^fact that payets reim- 
bursing'the hospital on a cost basis would adjust rates downward 
to counteract any increase in the volume of charges (1). At the 
other extreme, the analysis of the AHIS in ^he Radiology Depart- 
ment at the Hospital Qf the University of Pennsylvania counts as a 
cost benefit the full value of lost charges captured as a result of 
automation (estimated at 2,5%. of totaljkp^rtment charges) (3), 
This same method was used in the stufly a?|anta Monica Ho»pi- 
tal44). Others, su^h as S(^mitz iajijjf evaluJtfon of the AHIS at 
Deaconess Hospital' in Saint Louis (9), recognize that the evalua- 
tion of revenue implications is complex, and must consider reim- 
bursement patterns and patient mix. 

An AHIS can have two general types of impacts qn hpspital 
re\[enue. if^rfic-elapsed time between service delivery and billing 
is reduced; the hospital may be ^ble to reduc? the amount of a 
working .capitanoan»4a«d hence the interest owed) or receive a 
one-time increase in available cash^ Either way. reduction in re- 
ceivables is a tangible financial benefit to the hospital and the ' 
health care system. 

The second type'of revenue impacf is the capture of revenue 
previously lost to*the hospital because of inaccurate or^ incom- 
plete information about services delivered to patients. More ac- 
^curate billing f^r services, however, does not affect the costs of 
care. Since the tosts are incuriied when the services are delivered, 
these cost$ will exist whether or not the* services are billed. More 
accurate billing through 'automated charge oaptyre may influ- 
ence how costs are paid for and wjjo pays for th^m and it^may 
also affect the hospital's revenue; but it do^ not reduce the costs 
of care delivery. 
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Therefore, cost savings and revenue capture ^re two separate 
impacts of an AHIS. The inclusion of revenue capture as a cost 
savings in studies done in the past has led to overstated cost im- 
pacts. Revenue implications of an AHIS may' be of interest to a 
hospital administrator. However, analysis of revenue impacts 
should be conducted as a separate stlidy, not as part^of a c6st im- 
pact analysis. 

Any evaluation of revenue implications must recognize that 
there arg^at least three sets of variables that govern the revenue 
impacts at a particular hospital: 

• The type of system being evaluated and the measure of reve-* 
nue" capture used in the analysis. For example, revenues to de- 
partments within hospitals are often analyzed differently than 
revenues to the hospital. 

• The proportions of patients treated in the institutjpn who pay 
charges themselves or are covered by insiKance plans that pay 
hospital charges, and the proportion of patients covered by insur- 
ance plans that reimbui:se the hospital on some cost-related basis. 

The formulas used to determine hospital payment by each 
payer using a cost-related rate, and any overall limitations that 
are imposed on the hospital's budget or charges by state or Fed- 
eral regulatbry agencies. 

In order to understand any particular analysis of AHIs'-related 
revenue increases, it is necessary to understand each of these sets 
of variables and their effect on the calculation of revenues. 



Conclusions and recommendations 



■ .r 

Conclusions 

/ ~ . , 

• Few rigorous studies have been conducted of cost impacts ot 
implementation of automated hospital information systems. 

• Most of the^work done in this ^rea in the past has involved pre- 
dicting cost impacts. Somewhat overstated cost savings (largely 
the result of unrealistic labor savings and inclusion of revenue 
impacts) and understated system costs may have produced un- 
realistic estimates of the net cost impacts of AHIS. 

• Little work has been done on validating the results of predic- 
tive methodologies. Therefore, there is very little documentation 
of actual impacts of an AHIS on the productivity of hospital staff 
or on overall changes to guide the conduct of cost assessments. 

• Through improvements in information flow, an AHIS offers 
benefits to the quality of service delivery, and these are usually 
major motivations for a hospital to implement a system. More 
work needs to be done exploring the cost implications of improv- 
ments in the quality of service deHvery, such as improved turna- 
round time for test, results reporting and decreased loss of infor- 
mation. - " • ■ 

• Revenue recovery from charge capture i^ not a measure of 
changes in the costs of operating a hospital and, therefore, 
should not be counted amount the cost impacts. 

. Cost studii have been conducted for different hospital settings 
and system configurations. The specific methodologies employed 
are generally applicable, however, to any setting or system -type. 
The purpose in undertaking the cost study determines the ap- 
proach that is used. 
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Recommendations concerning approach to AHIS cost 
evaluation 



^ Until the results of predictive studies are validated, no single 
methodology for predicting AHIS cost impacts can be totally en- 

' dorsed. The approach recommended, however, builds upon the 
work dope in the past and avoids major pitfalls. The approach 
involves several steps, 

( 1 ) Defining system goals and objectives 

This will establish the .priority given to cost savings relative to 
other motivations for automating and identify the parameters of 
the cost study. ' * " 

(2) Identifying major cost impacts 

This is necessary iiot only because analyzing all impacts is very 
lime-consuming and costly, but also because departments per- 
forming thefgreate§t yeltlme of clerical information handling are 
the most likely to experience actual cost reductions. 

(3) Valuing labor impacts 

For labQF savings, the most re^fistic approach i^ to estimate work- 
load reductions by job content analysis (for non-nursing labor) 
and worrk sampling (for nursijng stalff) and then to develop new 
staffing plans incorporating work force reductions in consulta- 
tion with shift supervisors and department managers. 

(4) Checking predi'ctioT^ 

IdeaHy predictions should be compared with actual experience 
with similar installations at other hospitals. Until this type of in- 
formation becomes available, predictions can be compared with 
the results of previous predictive studies. 

(5) Identifying costs 

tlare has to be taken to identify all components of costs and to de- 
velop realistic estimates.of the total costs of the system. , 

(6) Establishing timeframe for stream of costs and cost savings 
Life cycle analysis and present value methodology provide a 
realistic analytical framework for a predurtive AHIS cost study. 

(7) Documentingactual system costs 

Because of ^he uncertainties regarding the accuracy of predicted 
cost impacts, any predictive' study should be accompanied by a 
commitment to monitor actual cost impacts after the system is 
implemwited. v 
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Recommended directions for future research ^ 

More research is needed lo help decisionmakers - hospitals, 
health planners, and regulators evaluate the cost impacts of 
AHIS, Since decisionmakers are primarily concerned with pre- 
dicting saviags prior to an investment in AHIS, it is important to 
validate whether the techniques being used to predict savings are; 
accurate^ 

Many diffcreni types of AHIS ape available and they varyy 
greatly in terms of scope, design, and cost. Information about 
the costs and benefits of individual system applications, such as 
medication ordering and radiology scheduling, would be useful 
for comparing systems with different features and for designing 
more cost-effective systems. -* ' 

Optimal use of an AHIS and realization of all potentiaLbene- 
fits requires a directed effort on the part of the users. Although 
some work has been done on developing a benefits realization 
program for certain AHI§ benefits (2). the expansion and trans- 
fer of this type of program from one institution to another has 
never been studied. Research on incentives is also needed to en- 

' soire that the benefits of future AHIS implementations are^naxi 
mized. This could involve disseminating information about the 
cost impacts of AMIS and the factors that determine savings, prp- 
viding technical assistance on cor^ucting bjenefits realization^ 
programs, and considering changes in reimbursement policy that 
would offer hospitals more immediate financial incentives to 
realize AHIS benefits. 

Before hospitals' tan incorporate the e5{perience at other ^kfis^ 

, into their decisionmaking about AHIS, the transferability of that 
experience has to be considered. Ideally, guidelines should be 
available concerning the range of cost impacts of different^auto- 
mated systems and the factors that determine the magnitude of 

' these at each installation. 

Most AHIS. and all comprehensive AHIS, are implemented 
primarily to improve patient care by improving the communica- 
tion of information. Therefore, techniques for examining the 

" cost impacts of these improvements in information f^ow wotild be 
extremely valuable in completely assessing the cost impacts of ^ 
automation. 
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{PHS) 81 3260 The Rhode Island Catastrophic Health Insurance Program, 

The First Three Years 
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(PHS)80 3265 How 4 Medical Information System Affects Hospital Costs , 

^ The El Cammo Hospital Experience 
iPHS)80 3266 Developing a Quality Assurance Strategy for Prinn^ry Care 
{PB 80-162 878) 

iPHS)8i 3277 Comparison ,o'f Strategies for the Development of Process 
Measures m EMS 

iPHS)8l 3298 Regulatmg Hospital Capital Investment The Experience in 
Massacfiu setts 

Research Re'ports 

The Research Report Series pvoskks significant research reports in their 
entiretv upon the completion of the project. Research Reports are 
developed bv the principal investigators who conducted the research, and 
are directed to seleaec?Visers of health services research as part of a conti , 
nuing NcksR effort to expedite the dissemination of new knowlec^^e 
resulting from its project support. 

(HRA)77 3152 . Hpw iLawyers Handle Medical Malpractice Cases (HRP 
/<0014313) 

(HRA) 77 3159^ Analysis of the Southern California Arbitration Project. 
'"January 1966^through June 1975 (HRP 0012466) 
Statutory Provisions for Binding. Arbitration of Medical 
Malpractice Cases (PB 264 409. available NTIS only) 
i960 ^nd 1970 Spanish Heritage Population of the Southwest 
by County (PB 280 656, available NTIS only) 
Drug Coverage under National Health Insurance The Policy 
Options (PB 272 074) 

Experimerrts m Interviewing Techniques Field Experjments 
in Health Reporting (PB 276 080. available NTIS only) 
tetehealth Handbook. A XSuide to Telecommunications 
Technology for Rural Health Care, (P& 292 557. available NTIS 
on^y) . ' . 

Emergency Medical Technician Performance Evaluation (PB 
285 961) 

Evaluation of Child Abuse #nd Neglect Demonstration Pre- 
lects, 1974-77, Vols 1 and 2"(PB 278 438 and 278 439; vols 
1 12, PB 278 437, the set) 

Needed Research in the Assessment and MofrtTurtfig of the 
Quality of Medical Car^JPB 288 826) 

A Cost-Effective Approach to Cervical Cancer Detection (PB 
295 515) " ■ . 

Cost_s and Benefits of Electronic Fetal MonitQriog A Review 
of the Literature^TRB 294 690) 
Computer'Applications in Health Care (PB 300 838) 
Effects and Costs of Day Care and Homemaker Services for 
the Chronically III A* Randomized Experiment (PB 80-138 100) 
Health Status. Medical Care Utilization, and Outcome An An- 
notated Bibliography of Empirical Studies, Parts l-IV (PB'284 
•^97. available NTIS only) 

Estirtiated Economic Costs* of Selected Medical Events 
Known (Jr Suspected to be Related to Administration of Com- 
mon Vaccines^ . * 
Health Care Stjrvey^ Osing Diaries 

A Social an5 Etonpmic Analysis of Professional Regulation 
in Optometry ^ , , 
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(HRA) 77 3165 
(HRA) 77-3184 
(HRA) 77-3189 
(PHS) 78-3204 
(PHS) 79-3210 

(PHS) 78 3211 

' (PHS) 79 3217 .1 
• 

(PHS) 78-32 1*9 

^. (PHS) 79-3237 

IPHS) 79-3245 

(PHS) 79-3251 
(PBS) 79-3258 

(PHS) 80-3263 

* JPHS) 81-3272 

(PHS) 80-3279 
- (PHS) 81-3295 



(PHS)81 3300 Hispanic Health Services Research — A Preliminary » * 

* Bibliography 
(PHS) 81, 3303 Health Planning Review of Medical Information Systems 



/ 



Research Proceedings 

The Research PrSieedin^s Series extends the avallabili'tj Bf new research 
annountud at ke\ Lunferences. svmpDsia and seminars sponsored or sup 
ported hv NC^HSR In addition to papers ^semed, pubHcations in this \ 
series uulude discussions and responses whoever possible. The series is 
intended to help meet the information needs of health services providers 
and odiers who re(|uire direct aciess lu contents and ideas evolving from ^ . 
the exchange of research results. ^ 

(HRA) 77 3154 Advances in Health Survey Research Methods (PB 262 230. 

available NTIS only) * 
(HRA) 77 3181 NCHSR Research Conference Report on Consumer Self-Care 

in Health (PB 273 811) 
^ (HRA) 77 3166 International Conference on Drug and Pharmaceutical Ser- * 
, vices Reimbursement (PB 271 386) 

tPHS) 78 3195 Emergency Medical Services Research Methodology (PB 279 ^ 
096) 

(PHS)-78 3207 Health Survey Research Methods. Second Biennial Con- 

, . ference (PB 293 492) ^ 
(PHS) 78 3208 Drug Coverage Under National Heafth Insurance (PB 293 468) . 
(PHS) 79.3209 ' Health Services Re^rch in Puerto Rico (PB 292 326) " • 
(PHS) 80 3215 Cost Accounting fo^ Pharmaceutjcal $^rvices (PB 80-167 936) 
(PHS) 79 3216 f^dical I^chnology ^he Culprit Behmd^ealth pare Costs'? * 

iPB 299.408) / ' _ ^ 

(Pbf^79 3225-1 Erperneltcy : Medical Services Research Methodology 

^ 'Worl^^^'l (PB 294 (548) . ' ' ^ . 
tPHS)79 3225 2 Emergency Medhcal Services Research Methodology " 

Wotkshop 2 (PB 80'142'292) ^ f^i 
(PHS) 78 3227 Effects of the Payment Mechanism on the Health Care 

DeMvery System (PB 291.231) ^ • } ^ 

.(PHS) 79 3228 A National ConferencS>oa Health Poii.cy. Planning, and Finan- 

cfng the Future of Health Care tor Blacks in America (PB 292 

559) ' ;j 0 

(PHS) 79 3233 Emergency Medical Services Systems as a Health Servic^ " 

Research Setting (PB 297 102) ^ 

(PHS) 79-3254 Medical Technology (PB 80-149,51 1) 

(PHS) 79-3256 Sharing Health Care Costs*(PB 80 '162 795) , 

(PHS) 79 3257^ Health Facility Reuse.. Retrofit, and Reconfiguration (PB 

' 80-142 383), • . \ 

(PHS) 81-3268 IHealth Survey Research MGthods/l979 ' . ' ' *• 

(PHS) 80-3288 Hispanic Health Services Research ^ # ' 



Research Management ^ ' /. 

The Research Management .SJriex lie^ribes programmatic rather than 
technical aspects of the NCHSR res^ar^h^effort. Information is presented 
^ ' ^ on the NCHSR goals, research objectives.' and priorities; in addition, this 



series uHUains lists ol grants and contracts, and administrative inforrtia- 
tion on funding. Public ations in this series arc iutended to bring basic in 
formation on NCHSR and its programs to research planners, <id- 
mimstrators. and others who are involved with the allocation of research 
resources. ** 

^PHS) 79-3220 • Emergency Medical Services Sfstems Research Projects. 
1978 (PB 292 558) 

(PHS)80 3271 Emergency Medical Services Systems Research Projects^ 
Abstracts. 1979 

(PHS) 81 3287 Computer Tapes Available from 20 Healtt^ Services Research * 
Projects 

(PHS) 81 3304 . Emergency Medical Services Research PfOject Abstracts. 
1980 

(PHS)81 3307 Summary of Grants and Contracts Active on September 
30.1978 



NHCES 

The i\^tional Health Care Expenditures Study Series presents informa 
tion and anal>ses on critical national health policy issues. Basic data were 
obtained from Khc National Medical Care Expenditure "Surv^. a 
statistical picture of how health setvices arc used and paid for:* Data 
Previews give preliminary estimates of key measures. 

(PHS) 80 3276 Data Preview 1 Who are the Umnsored'^ 

(PHS) 80 3275 Data Preview 2 Charges and Sources qf Payment for Dental 

, ' ^ Visifs with Separate Cfiarges 
(PHS) 80 3^78 ' Data Preview 3 Who Initiates Visits t,o Physician?* Offices'^ 
(PHS^ 80-3290. Data Preview 4 Health Insurance Coverage of Veterans 
(PH3) 80-3291 Data Preview'5 Charges and Sources of Payrrient for Visits to 
Physician Offices 

iPHS) 80-3296 Data Preview 6 Waiting Times in Different Medical Settings 
Appointment and Office Waits 



Policy Researeh . n 

The Polic\ Research Series describes finding^^from the research program 
that have major significance fdf policy issues of ^hc moment. These 
papers are prepared h\ members of the stafT of NCHSR or by indcpen 
'dent investigators. The scries is intended specifically to inform those in' 
the -public and private sectors who must consider, design, and implement 
policies affectij^g the delivery of health services 
(HRA) 773182 Controlling the Cost of Health Care*(PB 266 885) 

Program Solicitations . ^ 

(PHS) 81 3292 Grants for Research on Health Promotion and Disease 
Prevention v 



Rir 



47 



(PHS) 8t'3293 Extramural Associates Program, i98v 
(PHS) 8l<3299 Grants for Pissertation Support, 1981 



NCHSR Fact Sheets 

XCHSR Fact Sheets provide concise infonnation on NCHSR's organiza 
tion and mission, as well as on key problems in health services and 
research directed toward meeting health care needs. 

National Center for Health Services Research (English) 

National Center for Health Services Research (Spanish) 

National Center for Health Services Research (Chinese) 

NCHSR Research Focus. 1981 • 1982 

Catastrophic Illness 

Health Care and the Disadvantaged 

Hospital Cost and Utilization Proiect 

Long-term Care 

Manpower 

Maternal and Child Health Care ' ^ 
National Health Care Expenditures Study 
United Mine Workers of American Health Care Plan 
, Emergency Medical Services Systems 
NChSR Research Granr Application and Scientific/ 
Technical Merit Review Procedures 
Corriputer Applications in Health Care 
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